Delphi consensus reached to produce a decision tool for SelecTing Approaches for Rapid Reviews (STARR).

OBJECTIVES: There are many rapid review methods; however, there is little pragmatic guidance on which methods to select. This study aimed to reach consensus among international rapid review experts outlining areas to consider when selecting approaches for rapid reviews. STUDY DESIGN AND SETTING: A two-round modified online Delphi survey was conducted between May and July 2018. Participants were asked to rank the importance of a predefined list of 19 items. A consensus definition of at least 70% agreement for each item was decided a priori. RESULTS: Thirty experts from ten countries participated in round 1 and 24 in round 2. During round 1, consensus was reached on all items. One additional item on quality assessment was suggested by respondents and comments suggested wording changes to improve clarity and understanding of the tool. Respondents in the second round indicated a high level of importance and all 20 items achieved consensus. These items addressed interaction with commissioners, scoping and searching the evidence-base, data extraction and synthesis methods, and reporting of rapid review methods. CONCLUSION: International consensus was reached to produce the SelecTing Approaches for Rapid Reviews (STARR) decision tool for planning rapid reviews and will lead to improved shared understanding between review teams and review commissioners.

Cabozantinib and vandetanib for unresectable locally advanced or metastatic medullary thyroid cancer: a systematic review and economic model.

BACKGROUND: Medullary thyroid cancer (MTC) is a rare form of cancer that affects patients' health-related quality of life (HRQoL) and survival. Cabozantinib (Cometriq®; Ipsen, Paris, France) and vandetanib (Caprelsa®; Sanofi Genzyme, Cambridge, MA, USA) are currently the treatment modality of choice for treating unresectable progressive and symptomatic MTC. OBJECTIVES: (1) To evaluate the clinical effectiveness and safety of cabozantinib and vandetanib. (2) To estimate the incremental cost-effectiveness of cabozantinib and vandetanib versus each other and best supportive care. (3) To identify key areas for primary research. (4) To estimate the overall cost of these treatments in England. DATA SOURCES: Peer-reviewed publications (searched from inception to November 2016), European Public Assessment Reports and manufacturers' submissions. REVIEW METHODS: A systematic review [including a network meta-analysis (NMA)] was conducted to evaluate the clinical effectiveness and safety of cabozantinib and vandetanib. The economic analysis included a review of existing analyses and the development of a de novo model. RESULTS: The systematic review identified two placebo-controlled trials. The Efficacy of XL184 (Cabozantinib) in Advanced Medullary Thyroid Cancer (EXAM) trial evaluated the efficacy and safety of cabozantinib in patients with unresectable locally advanced, metastatic and progressive MTC. The ZETA trial evaluated the efficacy and safety of vandetanib in patients with unresectable locally advanced or metastatic MTC. Both drugs significantly improved progression-free survival (PFS) more than the placebo (p < 0.001). The NMA suggested that, within the symptomatic and progressive MTC population, the effects on PFS were similar (vandetanib vs. cabozantinib: hazard ratio 1.14, 95% credible interval 0.41 to 3.09). Neither trial demonstrated a significant overall survival benefit for cabozantinib or vandetanib versus placebo, although data from ZETA were subject to potential confounding. Both cabozantinib and vandetanib demonstrated significantly better objective response rates and calcitonin (CTN) and carcinoembryonic antigen (CEA) response rates than placebo. Both cabozantinib and vandetanib produced frequent adverse events, often leading to dose interruption or reduction. The assessment group model indicates that, within the EU-label population (symptomatic and progressive MTC), the incremental cost-effectiveness ratios (ICERs) for cabozantinib and vandetanib are > £138,000 per quality-adjusted life-year (QALY) gained. Within the restricted EU-label population (symptomatic and progressive MTC with CEA/CTN doubling times of ≤ 24 months), the ICER for vandetanib is expected to be > £66,000 per QALY gained. The maximum annual budget impact within the symptomatic and progressive population is estimated to be ≈£2.35M for cabozantinib and ≈£5.53M for vandetanib. The costs of vandetanib in the restricted EU-label population are expected to be lower. LIMITATIONS: The intention-to-treat populations of the EXAM and ZETA trials are notably different. The analyses of ZETA subgroups may be subject to confounding as a result of differences in baseline characteristics and open-label vandetanib use. Attempts to statistically adjust for treatment switching were unsuccessful. No HRQoL evidence was identified for the MTC population. CONCLUSIONS: The identified trials suggest that cabozantinib and vandetanib improve PFS more than the placebo; however, significant OS benefits were not demonstrated. The economic analyses indicate that within the EU-label population, the ICERs for cabozantinib and vandetanib are > £138,000 per QALY gained. Within the restricted EU-label population, the ICER for vandetanib is expected to be > £66,000 per QALY gained. FUTURE RESEARCH PRIORITIES: (1) Primary research assessing the long-term effectiveness of cabozantinib and vandetanib within relevant subgroups. (2) Reanalyses of the ZETA trial to investigate the impact of adjusting for open-label vandetanib use using appropriate statistical methods. (3) Studies assessing the impact of MTC on HRQoL. STUDY REGISTRATION: This study is registered as PROSPERO CRD42016050403. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Medullary thyroid carcinoma (MTC) is a rare form of cancer that presents as a mass of tumours in the thyroid gland of the neck. MTC affects both patients' health-related quality of life and survival. Targeted therapies (cabozantinib and vandetanib) are currently used to treat unresectable progressive and symptomatic MTC. The evidence for the use of cabozantinib and vandetanib in patients with unresectable locally advanced or metastatic MTC was reviewed, and two clinical trials were identified. The trials suggest that both drugs improve progression-free survival. Neither trial demonstrated significant survival benefits for cabozantinib or vandetanib. Both drugs produced frequent adverse events, often leading to dose interruption or reduction. Whether or not these therapies represent good value for money for the NHS was also assessed. Analyses indicate that the incremental cost-effectiveness ratios (ICERs) (a measure of cost-effectiveness) for cabozantinib and vandetanib versus best supportive care (BSC) in patients with symptomatic and progressive MTC are > £138,000 per quality-adjusted life-year (QALY) gained. Within a subgroup of patients with symptomatic and progressive MTC and carcinoembryonic antigen and/or calcitonin doubling times of ≤ 24 months, the ICER for vandetanib versus BSC remains > £66,000 per QALY gained.

Pembrolizumab for Locally Advanced or Metastatic Urothelial Cancer Where Cisplatin is Unsuitable: An Evidence Review Group Perspective of a NICE Single Technology Appraisal.

As part of its Single Technology Appraisal (STA) process, the National Institute for Health and Care Excellence (NICE) invited the manufacturer (Merck Sharp & Dohme) of pembrolizumab (Keytruda®) to submit evidence of its clinical and cost effectiveness for the treatment of locally advanced or metastatic urothelial cancer where cisplatin is unsuitable. The School of Health and Related Research Technology Appraisal Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a detailed review of the evidence for the clinical and cost effectiveness of the technology, based on the company's submission (CS) to NICE. The clinical effectiveness evidence in the CS for pembrolizumab was based on one phase II, single-arm, open-label, non-randomised study (KEYNOTE-052), while the evidence for the comparator (carboplatin plus gemcitabine) was based on four studies, including one randomised controlled trial and three cohort studies. In the absence of head-to-head trials, the company conducted an indirect treatment comparison for both progression-free survival (PFS) and overall survival (OS), by firstly adjusting cross-study differences using a simulated treatment comparison approach and then synthesizing the evidence based on an assumption of constant hazard ratios using a standard meta-analysis model and time-varying hazard ratios using fractional polynomial models. The treatment effect of pembrolizumab was more favourable in the adjusted population compared with the observed effect in the KEYNOTE-052 study. The company submitted a de novo partitioned survival cohort simulation model, which partitions the OS time into PFS and post-progression survival. The probabilistic incremental cost-effectiveness ratio (ICER) for pembrolizumab compared with carboplatin plus gemcitabine was estimated to be £37,081 per quality-adjusted life-year (QALY) gained, based on the results within the company's health economic model. Following a critique of the model, for their preferred base case the ERG corrected some minor model errors, chose a progression approach for estimating utilities, and revised the extrapolation of PFS and OS. The ERG's probabilistic base case ICER was estimated to be £67,068 per QALY gained. The ERG also undertook a range of exploratory sensitivity analyses which suggested that the ICER was highly uncertain. In particular, the choices of extrapolation for the OS of pembrolizumab and the stopping rule for pembrolizumab had the largest impacts on the ICER. The NICE Appraisal Committee recommended pembrolizumab for use within the Cancer Drugs Fund as an option for treating locally advanced or metastatic urothelial carcinoma in adults who have had platinum-containing chemotherapy, provided that pembrolizumab was stopped at 2 years of uninterrupted treatment, or earlier if the disease progresses, and the conditions of the managed access agreement for pembrolizumab are followed.

Ibrutinib for Treating Relapsed or Refractory Mantle Cell Lymphoma: An Evidence Review Group Perspective of a NICE Single Technology Appraisal.

As part of its Single Technology Appraisal process, the UK National Institute for Health and Care Excellence (NICE) invited the manufacturer of ibrutinib (Janssen) to submit evidence on the clinical effectiveness and cost effectiveness of ibrutinib for the treatment of relapsed or refractory (R/R) mantle cell lymphoma (MCL). The School of Health and Related Research Technology Assessment Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a critical review of the evidence contained within the company's submission to NICE. The clinical effectiveness evidence for ibrutinib included one randomised controlled trial comparing ibrutinib and temsirolimus and two single-arm studies. The company's indirect comparison of ibrutinib versus rituximab plus chemotherapy (R-chemo) produced a hazard ratio (HR) for progression-free survival (PFS) of 0.28. The ERG's random effects network meta-analysis (NMA) indicated that the treatment effect on PFS was highly uncertain (HR 0.27; 95% credible interval (CrI) 0.06-1.26). The company's Markov model assessed the cost effectiveness of ibrutinib versus R-chemo for the treatment of R/R MCL from the perspective of the National Health Service (NHS) and Personal Social Services over a lifetime horizon. Based on a re-run of the company's model by the ERG, the incremental cost-effectiveness ratio (ICER) for ibrutinib versus R-chemo [including the company's original patient access scheme (PAS)] was expected to be £76,014 per quality-adjusted life-year (QALY) gained. The ERG had several concerns regarding the company's model structure and the evidence used to inform its parameters. The ERG's preferred analysis, which used the ERG's NMA and the observed Kaplan-Meier curve for time to ibrutinib discontinuation and excluded long-term disutilities for R-chemo, produced ICERs of £63,340 per QALY gained for the overall R/R MCL population and of £44,711 per QALY gained for patients with one prior treatment. Following an updated PAS and consideration of evidence from a later data-cut of the RAY trial, the appraisal committee concluded that the most plausible ICER for the one prior treatment subgroup was likely to be lower than the company's estimate of £49,848 per QALY gained. The company's ICER for the overall R/R MCL population was higher, at £62,650 per QALY gained. The committee recommended ibrutinib as an option for treating R/R MCL in adults only if they have received only one previous line of therapy and the company provides ibrutinib with the discount agreed in the commercial access agreement with NHS England.

Nature and reporting characteristics of UK health technology assessment systematic reviews.

BACKGROUND: A recent study by Page et al. (PLoS Med. 2016;13(5):e1002028) claimed that increasing numbers of reviews are being published and many are poorly-conducted and reported. The aim of the present study was to assess how well reporting standards of systematic reviews produced in a Health Technology Assessment (HTA) context compare with reporting in Cochrane and other 'non-Cochrane' systematic reviews from the same years (2004 and 2014), as reported by Page et al. (PLoS Med. 2016;13(5):e1002028). METHODS: All relevant UK HTA programme systematic reviews published in 2004 and 2014 were identified. After piloting of the form, two reviewers each extracted relevant data on conduct and reporting from these reviews. These data were compared with data for Cochrane and "non-Cochrane" systematic reviews, as published by Page et al. (PLoS Med. 2016;13(5):e1002028). All data were tabulated and summarized. RESULTS: There were 30 UK HTA programme systematic reviews and 300 other systematic reviews, including Cochrane reviews (n = 45). The percentage of HTA reviews with required elements of conduct and reporting was frequently very similar to Cochrane and much higher than all other systematic reviews, e.g. availability of protocols (90, 98 and 16% respectively); the specification of study design criteria (100, 100, 79%); the reporting of outcomes (100, 100, 78%), quality assessment (100, 100, 70%); the searching of trial registries for unpublished data (70, 62, 19%); reporting of reasons for excluding studies (91, 91 and 70%) and reporting of authors' conflicts of interests (100, 100, 87%). HTA reviews only compared less favourably with Cochrane and other reviews in assessments of publication bias. CONCLUSIONS: UK HTA systematic reviews are often produced within a specific policy-making context. This context has implications for timelines, tools and resources. However, UK HTA systematic reviews still tend to present standards of conduct and reporting equivalent to "gold standard" Cochrane reviews and superior to systematic reviews more generally.

Patient-Reported Outcome Measures in Carotid Artery Revascularization: Systematic Review and Psychometric Analysis.

BACKGROUND: Patient-reported outcome measures (PROMs) provide a way to measure the impact of a disease and its associated treatments on the quality of life (QoL) from the patients' perspective. The aim of this review was to identify PROMs that have been developed and/or validated in patients with carotid artery stenosis (CAS) undergoing revascularization and to assess their psychometric properties and examine suitability for research and clinical use. METHODS: Eight electronic databases including MEDLINE and CINAHL were searched using a 2-stage search approach to identify studies reporting the development and/or validation of relevant PROMs in patients with CAS undergoing revascularization. Supplementary citation searching and hand-searching reference lists of included studies were also undertaken. The COnsensus-based Standards for the selection of health Measurement INstruments and Oxford criteria were used to assess the methodological quality of the included studies, and the psychometric properties of the PROMs were evaluated using established assessment criteria. RESULTS: Five studies reporting on 6 PROMs were included: 36-Item Short Form Health Survey (SF-36), Euro-QoL-5-Dimension Scale (EQ-5D), Hospital Anxiety and Depression Scale, Dizziness Handicap Inventory, QoL for carotid artery disease scale, and a disease-specific PROM for CAS. The rigor of the psychometric assessment of the PROMs was variable with most only attempting to assess a single psychometric criterion. No study reported evidence on construct validity and test-retest reliability. Evidence for acceptability for the use of SF-36, EQ-5D, and the disease-specific PROM was rated good in most studies. Only one study reported a Cronbach alpha score >0.70 as evidence of internal consistency. Overall, the psychometric evaluation of all included PROMs was rated as poor within the CAS population undergoing revascularization. CONCLUSIONS: This review highlighted a lack of evidence in validated PROMs used for patients undergoing carotid artery revascularization. As a result, the development and validation of a new PROM for this patient population is warranted to provide data which can supplement traditional clinical outcomes (stroke<30 days post-procedural, myocardial infarction, and death) and capture changes in health status and QoL to help inform treatment decisions.

What Is the Evidence from Past National Institute of Health and Care Excellence Single-Technology Appraisals Regarding Company Submissions with Base-Case Incremental Cost-Effectiveness Ratios of Less Than £10,000/QALY?

BACKGROUND: The National Institute for Health and Care Excellence has recently proposed that company submissions with a base-case incremental cost-effectiveness ratio (ICER) of less than £10,000/quality-adjusted life-year (QALY) might be eligible for a "fast-track" appraisal. OBJECTIVES: To explore outcomes relating to previously conducted single-technology appraisals (STAs) with base-case ICERs of less than £10,000/QALY. METHODS: All STAs with published guidance from 2009 to 2016 were included; those with company base-case ICERs of less than £10,000/QALY were identified and analyzed. A secondary analysis was also conducted for those with a company base-case ICER of £10,000 to £15,000/QALY. Relevant data were extracted and presented in a narrative and in tables. RESULTS: In total, 15% (26 of 171) of STAs included a company submission with a base-case ICER of less than £10,000/QALY. Of these, 73% (19 of 26) were given positive recommendations after the first Appraisal Committee (AC) meeting, whereas 27% (7 of 26) were initially given a Minded No before receiving a positive recommendation in the final appraisal determination, albeit with restricted recommendations for three technologies. Five STAs had company base-case ICERs of £10,000 to £15,000/QALY and all received a positive recommendation after the first AC meeting. CONCLUSIONS: Most previous STAs with a company base-case ICER of £10,000 or even £15,000/QALY received a positive recommendation after the first AC meeting, but a number of them proved more complicated and required detailed appraisal, which influenced the final recommendation. This finding might have implications for the proposed fast-track process of the National Institute for Health and Care Excellence.

Barriers and Facilitators to the Implementation of Interventions to Prevent Youth Violence in Latin America: A Systematic Review and Qualitative Evidence Synthesis.

Youth violence in Latin America is an important public health problem. However, the evidence from preventive programs within the region to address this problem is limited. Identifying context-specific factors that facilitate or hinder the success of interventions is necessary to guarantee the successful implementation of new preventive strategies. We present a systematic review and synthesis of qualitative studies to identify factors affecting the implementation of programs to prevent youth violence in Latin America. We searched 10 electronic databases and websites of international institutions. The quality of the studies was assessed using the critical appraisal skills program checklist, while the certainty of the findings of the synthesis was assessed using the certainty of the qualitative evidence approach. We included eight papers describing five programs in Argentina, Venezuela, Peru, El Salvador, and Mexico. Most of the factors affecting the implementation of programs were aspects related to features of the programs and social/political constraints. The synthesis suggests that future programs can benefit from having a multidisciplinary and/or multisectoral approach involving different key players. At the same time, potential strategies for avoiding problems related to such active engagement should be planned via promoting effective channels for communication and supervision. The review also suggests the importance of increasing awareness and motivation toward the problem of youth violence among relevant agencies and stakeholders. While the limited volume and quality of the literature impact on the ability to draw conclusions, the results could be useful for new programs being designed and the ones seeking to be adapted from other contexts.

Pertuzumab for the Neoadjuvant Treatment of Early-Stage HER2-Positive Breast Cancer: An Evidence Review Group Perspective of a NICE Single Technology Appraisal.

As part of its single technology appraisal process, the National Institute for Health and Care Excellence invited the manufacturer of pertuzumab (Perjeta®; Roche Products Limited) to submit evidence of its clinical and cost- effectiveness for the neoadjuvant treatment of women with high-risk, early-stage, HER2-positive breast cancer when used in combination with trastuzumab and chemotherapy. High-risk women included those with locally advanced (including inflammatory) breast cancer and women with high-risk early-stage breast cancer (classified as T2/3 or N1). The School of Health and Related Research Technology Appraisal Group at the University of Sheffield was commissioned to act as the independent Evidence Review Group. This article presents the critical review of the company's submission by the Evidence Review Group and the outcome of the National Institute for Health and Care Excellence guidance. The clinical data were mainly taken from a phase II, randomised, open-label, active controlled study (NeoSphere), which reported a significant advantage in terms of pathological complete response rates of pertuzumab in combination with trastuzumab and chemotherapy, compared with trastuzumab alone with chemotherapy (45.8 vs. 29.0%, p = 0.0141). The company did not make any indirect comparisons. A meta-analysis of 12 neoadjuvant studies investigating the relationship between pathological complete response and event-free survival was used to extrapolate the outcomes reported in the NeoSphere study. A cardiac safety study (TRYPHAENA) demonstrated the safety of pertuzumab. The company undertook a model-based economic evaluation of neoadjuvant pertuzumab plus trastuzumab and docetaxel compared with neoadjuvant trastuzumab and docetaxel over a lifetime horizon from the National Health Service and Personal Social Services perspective. The probabilistic incremental cost-effectiveness ratio was estimated to be £20,104 per quality-adjusted life-year gained for pertuzumab alongside trastuzumab and docetaxel compared with trastuzumab and docetaxel, which was revised to £21,869 per quality-adjusted life-year gained following the clarification process. The Evidence Review Group corrected an error in the digitisation of the survivor functions and modified the clinically inappropriate assumption that recurrence is zero after 7 years. The Evidence Review Group's probabilistic base case was £23,962 per quality-adjusted life-year gained. During the appraisal, to mitigate the uncertainties associated with the evidence, the company offered a patient access scheme, which led to the National Institute for Health and Care Excellence Appraisal Committee recommending pertuzumab in this patient group, subject to the company providing the agreed discount in the patient access scheme.

Phosphodiesterase Type 5 Inhibitors for Premature Ejaculation: A Systematic Review and Meta-analysis.

CONTEXT: Phosphodiesterase type 5 inhibitors (PDE5-Is) are prescribed off-label for the treatment of premature ejaculation (PE). OBJECTIVE: To systematically review the evidence from randomised controlled trials (RCTs) for PDE5-Is in the management of PE. EVIDENCE ACQUISITION: Medline and other databases were searched through September 2015. Quality of RCTs was assessed. Intravaginal ejaculatory latency time (IELT) data were pooled in a meta-analysis. Heterogeneity was assessed. EVIDENCE SYNTHESIS: Fifteen RCTs were included. The majority were of unclear methodological quality. Pooled IELT evidence suggests that PDE5-Is are significantly more effective than placebo (231 participants, p<0.00001), that there is no difference between PDE5-Is and selective serotonin reuptake inhibitors (SSRIs; 405 participants, p=0.50), and that PDE5-Is combined with an SSRI are significantly more effective than SSRIs alone (521 participants, p=0.001); however, high levels of statistical heterogeneity are evident (I2 ≥ 40%). Single-RCT evidence suggests that sildenafil is significantly more effective than the squeeze technique, but both lidocaine gel and tramadol are significantly more effective than sildenafil. Sildenafil combined with behavioural therapy is significantly more effective than behavioural therapy alone. Sexual satisfaction and ejaculatory control appear to be better with PDE5-Is compared with placebo and with PDE5-Is combined with an SSRI compared with an SSRI alone. Adverse events are reported with both PDE5-Is and other agents. CONCLUSIONS: PDE5-Is are significantly more effective than placebo and PDE5-Is combined with an SSRI are significantly more effective than SSRIs alone at increasing IELT and improving other effectiveness outcomes; however, heterogeneity is evident across RCTs. The methodological quality of the majority of RCTs is unclear. PATIENT SUMMARY: We reviewed phosphodiesterase type 5 inhibitors (PDE5-Is) for treating premature ejaculation. We found evidence to suggest that PDE5-Is are effective compared with placebo and that PDE5-Is combined with an SSRI are more effective than an SSRI alone. Adverse events are reported with PDE5-Is and other agents; however, the quality of the evidence is uncertain. TRIAL REGISTRATION: PROSPERO registration number CRD42013005289.

The Type and Impact of Evidence Review Group Exploratory Analyses in the NICE Single Technology Appraisal Process.

BACKGROUND: As part of the UK National Institute for Health and Care Excellence (NICE) single technology appraisal process, independent evidence review groups (ERGs) critically appraise a company's submission relating to a specific technology and indication. OBJECTIVES: To explore the type of additional exploratory analyses conducted by ERGs and their impact on the recommendations made by NICE. METHODS: The 100 most recently completed single technology appraisals with published guidance were selected for inclusion. A content analysis of relevant documents was undertaken to identify and extract relevant data, and narrative synthesis was used to rationalize and present these data. RESULTS: The types of exploratory analysis conducted in relation to companies' models were fixing errors, addressing violations, addressing matters of judgment, and the provision of a new, ERG-preferred base case. Ninety-three of the 100 ERG reports contained at least one of these analyses. The most frequently reported type of analysis in these 93 ERG reports related to the category "Matters of judgment," which was reported in 83 reports (89%). At least one of the exploratory analyses conducted and reported by an ERG is mentioned in 97% of NICE appraisal consultation documents and 94% of NICE final appraisal determinations, and had a clear influence on recommendations in 72% of appraisal consultation documents and 47% of final appraisal determinations. CONCLUSIONS: These results suggest that the additional analyses undertaken by ERGs in the appraisal of company submissions are highly influential in the policy-making and decision-making process.

The Relationship between Hospital or Surgeon Volume and Outcomes in Lower Limb Vascular Surgery in the United Kingdom and Europe.

BACKGROUND: Peripheral vascular disease is a major cause of death and disability. The extent to which volume influences outcome of lower limb (LL) vascular surgery remains unclear. This review evaluated the relationship between hospital/surgeon volume and outcome in LL surgery. METHODS: Electronic databases-MEDLINE, Embase, the Cochrane Library Databases, Science Citation Index, and CINAHL-proceedings from conferences, citations, and references of included studies were searched. Studies from Europe, of adults undergoing LL vascular surgery reporting outcomes by hospital or surgeon volume were included. The quality of studies was assessed using a modified Cochrane Risk Of Bias Assessment Tool: for Non-Randomized Studies of Interventions (Robins1) tool. The association between hospital/surgeon volume and outcome was summarized using tables. RESULTS: Nine studies from different European countries, comprising 67,445 patients who had undergone diverse LL surgeries were included. The increase in hospital/surgeon volume was associated with a decrease in post-operative amputations (hospital at 30 days [odds ratio {OR}: 0.20, 95% confidence interval {CI} 0.29-0.45, P = 0.01; OR: 0.67, 95% CI 0.44-0.9, P = 0.05; OR: 0.96, 95% CI 0.92-1.00, P = 0.06], at 1 year [OR: 0.96, 95% CI 0.93-0.98, P = 0.002; OR: 0.66, 95% CI 0.52-0.84, P < 0.001; OR: 2.05, 95% CI 1.24-3.42, P = 0.01], surgeon at 30 days [OR: 0.53, 95% CI 0.36-0.87, P = 0.01; OR: 0.40, 95% CI 0.18-0.91, P = 0.03; OR: 0.41, 95% CI 0.24-0.69, P = 0.0006]). The evidence on an association between hospital/surgeon volume and mortality was contradictory, but mortality and amputations may covary by hospital volume. There were an insufficient number of studies reporting on the other variables to draw firm conclusions, but their results suggest that high-volume hospitals may undertake more repeated surgeries/revascularizations and limb salvage. The impact of hospital/surgical volume on adverse events and length of hospitalization could not be determined. CONCLUSIONS: High-volume hospitals/surgeons may undertake fewer amputations and mortality and amputations may covary. The finding that hospital and surgeon volume affected the number of secondary amputations has implications on reorganization of vascular surgery services. However, due to the small number and poor quality of some of the included studies, decisions on reorganization of LL vascular surgery services should be supplemented by results from clinical audits. There is need for standardization of definition of volume stratification of outcomes by patient's clinical conditions.

Adalimumab for Treating Moderate-to-Severe Hidradenitis Suppurativa: An Evidence Review Group Perspective of a NICE Single Technology Appraisal.

As part of its single technology appraisal (STA) process, the UK National Institute for Health and Care Excellence (NICE) invited the manufacturer of adalimumab (AbbVie) to submit evidence on the clinical effectiveness and cost effectiveness of adalimumab for the treatment of moderate-to-severe hidradenitis suppurativa (HS). The appraisal assessed adalimumab as monotherapy in adult patients with an inadequate response to conventional systemic HS therapy. The School of Health and Related Research Technology Appraisal Group was commissioned to act as the independent Evidence Review Group (ERG). The ERG produced a critical review of the evidence for the clinical effectiveness and cost effectiveness of the technology based on the company's submission to NICE. The evidence was mainly derived from three randomised controlled trials comparing adalimumab with placebo in adults with moderate-to-severe HS. The clinical-effectiveness review found that significantly more patients achieved a clinical response in the adalimumab groups than in the control groups but that the treatment effect varied between trials and there was uncertainty regarding its impact on a range of other relevant outcomes as well as long-term efficacy. The company's submitted Markov model assessed the incremental cost effectiveness of adalimumab versus standard care for the treatment of HS from the perspective of the UK NHS and Personal Social Services (PSS) over a lifetime horizon. The original submitted model, including a patient access scheme (PAS), suggested that the incremental cost-effectiveness ratio (ICER) for adalimumab versus standard care was expected to be £16,162 per quality-adjusted life-year (QALY) gained. Following a critique of the model, the ERG's preferred base case, which corrected programming errors and structural problems surrounding discontinuation rules and incorporated a lower unit cost for HS surgery, resulted in a probabilistic ICER of £29,725 per QALY gained. Based on additional analyses undertaken by the company and the ERG following the publication of the appraisal consultation document (ACD), the Appraisal Committee concluded that the maximum possible ICER for adalimumab compared with supportive care was between £28,500 and £33,200 per QALY gained but was likely to be lower. The Appraisal Committee recommended adalimumab (with the PAS) for the treatment of active moderate-to-severe HS in adults whose disease has not responded to conventional systemic therapy.

Complementary and Alternative Medicine for Management of Premature Ejaculation: A Systematic Review.

INTRODUCTION: Premature ejaculation (PE) is defined as ejaculation within 1 minute (lifelong PE) or 3 minutes (acquired PE), inability to delay ejaculation, and negative personal consequences. Management includes behavioral and pharmacologic approaches. AIM: To systematically review effectiveness, safety, and robustness of evidence for complementary and alternative medicine in managing PE. METHODS: Nine databases including Medline were searched through September 2015. Randomized controlled trials evaluating complementary and alternative medicine for PE were included. MAIN OUTCOME MEASURES: Studies were included if they reported on intravaginal ejaculatory latency time (IELT) and/or another validated PE measurement. Adverse effects were summarized. RESULTS: Ten randomized controlled trials were included. Two assessed acupuncture, five assessed Chinese herbal medicine, one assessed Ayurvedic herbal medicine, and two assessed topical "severance secret" cream. Risk of bias was unclear in all studies because of unclear allocation concealment or blinding, and only five studies reported stopwatch-measured IELT. Acupuncture slightly increased IELT over placebo in one study (mean difference [MD] = 0.55 minute, P = .001). In another study, Ayurvedic herbal medicine slightly increased IELT over placebo (MD = 0.80 minute, P = .001). Topical severance secret cream increased IELT over placebo in two studies (MD = 8.60 minutes, P < .001), although inclusion criteria were broad (IELT < 3 minutes). Three studies comparing Chinese herbal medicine with selective serotonin reuptake inhibitors (SSRIs) favored SSRIs (MD = 1.01 minutes, P = .02). However, combination treatment with Chinese medicine plus SSRIs improved IELT over SSRIs alone (two studies; MD = 1.92 minutes, P < .00001) and over Chinese medicine alone (two studies; MD = 2.52 minutes, P < .00001). Adverse effects were not consistently assessed but where reported were generally mild. CONCLUSION: There is preliminary evidence for the effectiveness of acupuncture, Chinese herbal medicine, Ayurvedic herbal medicine, and topical severance secret cream in improving IELT and other outcomes. However, results are based on clinically heterogeneous studies of unclear quality. There are sparse data on adverse effects or potential for drug interactions. Further well-conducted randomized controlled trials would be valuable.

Interventions to prevent youth violence in Latin America: a systematic review.

OBJECTIVES: This review aims to summarise evidence on the effectiveness of interventions to prevent youth violence in Latin America. METHODS: A systematic search on 13 academic databases was conducted to locate studies evaluating a primary or secondary prevention intervention in Latin America. Studies could use any type of quantitative design to assess outcomes related to youth violence. A search of websites, references and citation searching was also carried out. The quality of each study was assessed. RESULTS: Nine studies were identified. Most documented positive effects of the interventions on the perception of youth violence present in the community/school. Evidence was found of a reduction in homicides and juvenile crimes in three studies, two of which evaluated a community-based intervention. There were mixed results for the self-report of participation on violent acts. The majority of the studies lacked of a rigorous design. CONCLUSIONS: Most of the interventions had some promising results, including the reduction of homicides within communities. Community-based programmes were the most consistent regarding an effectiveness to prevent violence. However, the evidence for Latin America is still scarce and relies on non-rigorously designed studies.

Issues Related to the Frequency of Exploratory Analyses by Evidence Review Groups in the NICE Single Technology Appraisal Process.

BACKGROUND: Evidence Review Groups (ERGs) critically appraise company submissions as part of the National Institute for Health and Care Excellence (NICE) Single Technology Appraisal (STA) process. As part of their critique of the evidence submitted by companies, the ERGs undertake exploratory analyses to explore uncertainties in the company's model. The aim of this study was to explore pre-defined factors that might influence or predict the extent of ERG exploratory analyses. OBJECTIVE: The aim of this study was to explore predefined factors that might influence or predict the extent of ERG exploratory analyses. METHODS: We undertook content analysis of over 400 documents, including ERG reports and related documentation for the 100 most recent STAs (2009-2014) for which guidance has been published. Relevant data were extracted from the documents and narrative synthesis was used to summarise the extracted data. All data were extracted and checked by two researchers. RESULTS: Forty different companies submitted documents as part of the NICE STA process. The most common disease area covered by the STAs was cancer (44%), and most ERG reports (n = 93) contained at least one exploratory analysis. The incidence and frequency of ERG exploratory analyses does not appear to be related to any developments in the appraisal process, the disease area covered by the STA, or the company's base-case incremental cost-effectiveness ratio (ICER). However, there does appear to be a pattern in the mean number of analyses conducted by particular ERGs, but the reasons for this are unclear and potentially complex. CONCLUSIONS: No clear patterns were identified regarding the presence or frequency of exploratory analyses, apart from the mean number conducted by individual ERGs. More research is needed to understand this relationship.

Patient-reported outcome measures in patients with peripheral arterial disease: a systematic review of psychometric properties.

BACKGROUND: Peripheral arterial disease (PAD) is generally associated with considerable morbidity and reduced quality of life. Patient-reported outcome measures (PROMs) provide important information about the burden of disease and impact of treatment in affected patients. OBJECTIVES: The objective of the review was to identify and appraise studies reporting the psychometric evaluation of PROMs administered to a specified population of patients with PAD with a view to recommending suitable PROMs. METHODS: A systematic review of peer-reviewed English language articles was undertaken to identify primary studies reporting psychometric properties of PROMs in English-speaking patients with various stages of PAD. Comprehensive searches were completed up until January 2015. Study selection, data extraction and quality assessment were undertaken independently by at least two researchers. Findings were presented as tabular and narrative summaries based on accepted guidance. RESULTS: Psychometric evaluation of 6 generic and 7 condition-specific PROMs reported in 14 studies contributed data to the review. The frequently reported measure was the SF-36 (n = 11 studies); others included the Walking Impairment Questionnaire (n = 8 studies), EQ-5D (n = 5 studies) and the Vascular Quality of Life Questionnaire (n = 3 studies). Studies included a diverse PAD population and varied in methodology, including approach to validation of PROMs. CONCLUSIONS: Various PROMs have been validated in patients with PAD but no study provided evidence of a full psychometric evaluation in the patient population. Careful selection is required to identify reliable and valid PROMs to use in clinical and research settings.

The use of rapid review methods in health technology assessments: 3 case studies.

BACKGROUND: Rapid reviews are of increasing importance within health technology assessment due to time and resource constraints. There are many rapid review methods available although there is little guidance as to the most suitable methods. We present three case studies employing differing methods to suit the evidence base for each review and outline some issues to consider when selecting an appropriate method. METHODS: Three recently completed systematic review short reports produced for the UK National Institute for Health Research were examined. Different approaches to rapid review methods were used in the three reports which were undertaken to inform the commissioning of services within the NHS and to inform future trial design. We describe the methods used, the reasoning behind the choice of methods and explore the strengths and weaknesses of each method. RESULTS: Rapid review methods were chosen to meet the needs of the review and each review had distinctly different challenges such as heterogeneity in terms of populations, interventions, comparators and outcome measures (PICO) and/or large numbers of relevant trials. All reviews included at least 10 randomised controlled trials (RCTs), each with numerous included outcomes. For the first case study (sexual health interventions), very diverse studies in terms of PICO were included. P-values and summary information only were presented due to substantial heterogeneity between studies and outcomes measured. For the second case study (premature ejaculation treatments), there were over 100 RCTs but also several existing systematic reviews. Data for meta-analyses were extracted directly from existing systematic reviews with new RCT data added where available. For the final case study (cannabis cessation therapies), studies included a wide range of interventions and considerable variation in study populations and outcomes. A brief summary of the key findings for each study was presented and narrative synthesis used to summarise results for each pair of interventions compared. CONCLUSIONS: Rapid review methods need to be chosen to meet both the nature of the evidence base of a review and the challenges presented by the included studies. Appropriate methods should be chosen after an assessment of the evidence base.

The use of exploratory analyses within the National Institute for Health and Care Excellence single technology appraisal process: an evaluation and qualitative analysis.

BACKGROUND: As part of the National Institute for Health and Care Excellence (NICE) single technology appraisal (STA) process, independent Evidence Review Groups (ERGs) critically appraise the company submission. During the critical appraisal process the ERG may undertake analyses to explore uncertainties around the company's model and their implications for decision-making. The ERG reports are a central component of the evidence considered by the NICE Technology Appraisal Committees (ACs) in their deliberations. OBJECTIVE: The aim of this research was to develop an understanding of the number and type of exploratory analyses undertaken by the ERGs within the STA process and to understand how these analyses are used by the NICE ACs in their decision-making. METHODS: The 100 most recently completed STAs with published guidance were selected for inclusion in the analysis. The documents considered were ERG reports, clarification letters, the first appraisal consultation document and the final appraisal determination. Over 400 documents were assessed in this study. The categories of types of exploratory analyses included fixing errors, fixing violations, addressing matters of judgement and the ERG-preferred base case. A content analysis of documents (documentary analysis) was undertaken to identify and extract relevant data, and narrative synthesis was then used to rationalise and present these data. RESULTS: The level and type of detail in ERG reports and clarification letters varied considerably. The vast majority (93%) of ERG reports reported one or more exploratory analyses. The most frequently reported type of analysis in these 93 ERG reports related to the category 'matters of judgement', which was reported in 83 (89%) reports. The category 'ERG base-case/preferred analysis' was reported in 45 (48%) reports, the category 'fixing errors' was reported in 33 (35%) reports and the category 'fixing violations' was reported in 17 (18%) reports. The exploratory analyses performed were the result of issues raised by an ERG in its critique of the submitted economic evidence. These analyses had more influence on recommendations earlier in the STA process than later on in the process. LIMITATIONS: The descriptions of analyses undertaken were often highly specific to a particular STA and could be inconsistent across ERG reports and thus difficult to interpret. CONCLUSIONS: Evidence Review Groups frequently conduct exploratory analyses to test or improve the economic evaluations submitted by companies as part of the STA process. ERG exploratory analyses often have an influence on the recommendations produced by the ACs. FUTURE WORK: More in-depth analysis is needed to understand how ERGs make decisions regarding which exploratory analyses should be undertaken. More research is also needed to fully understand which types of exploratory analyses are most useful to ACs in their decision-making. FUNDING: The National Institute for Health Research Health Technology Assessment programme.